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Data Structures 



A. Data structures maintained by socket layer: 

1. Connection state maintained by socket layer (SONODE): Socket state 
information. 

SOCKET LAYER CONNECTION IDENTIFIER 
HARDWARE CONNECTION IDENTIFIER 

POINTER TO CONNECTION STATE MAINTAINED BY KERNEL (* 

CONNT) 

2. Connection state table maintained by socket layer: 



Identifier 


State information 


A 


Pointer to socket layer connection state 











B. Connection state maintained by kernel (CONNT): TCP/IP state information 

KERNEL CONNECTION IDENTIFIER 

1. Minimum state necessary to offload a connection (MIN_TCP_T): 
Local (server) and remote (client) IP addresses and ports 
Send/receive sequence numbers of packets for the connection 
Any round trip estimates for each packet 
Congestion window, slow start 

C. Hardware connection state maintained by NIC (HW_CONN_T): NIC 
connection state 

HARDWARE CONNECTION IDENTIFIER (HW_CONNID) 
POINTER TO SOCKET STATE INFORMATION (*SONODE) 

1 . Minimum state necessary to offload a connection (MIN_TCP_T): 
Local (server) and remote (client) IP addresses and ports 
Send/receive sequence numbers of packets for the connection 
Any round trip estimates for each packet 
Congestion window, slow start 
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Software establishes network 
connection such that state 

information for the 
connection is generated 
(see FIG. 5) 
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Software handles the network 
connection and determines 
whether to offload the 
connection to H/W 
(see FIG. 6) 


^--404 




H/W and S/W 
exchange state 
information for the 
connection such 
that a mapping 
is established 
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H/W handles the 
connection until it 
decides to offload 
the connection back 
to SW (see FIG. 7) 
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(Establish 
connection 



New connection request 
is received by software 
layer from client 
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Kernel creates kernel connection 
state including kernel connection 
identifier and provides to TCP layer 
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3-way TCP 
handshake completed 
in software 
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Socket layer creates socket connection 
state including socket layer connection 
508 \J~ identifier as part of application 

accepting connection 



Socket layer provides access to at least 
a portion of socket connection state or 
510 \f~ provides socket layer connection 
identifier to the TCP layer as part of 
application accepting connection 



TCP layer provides access to at least 
a portion of kernel connection state or 
^ 1 2 \J~1 provides kernel connection identifier 
to the socket layer as part of 
application accepting connection 



Figure 5 
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(S/W processes A 
connection J 



Application layer 
receives request 
for data from 
client 
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Application layer provides 
data to send to client to 
socket layer using one of 
four system calls 
(send_file, send_filev, 
write_writev) 
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Mapping 
established 
between software 
connection state 

and hardware 
connection state 
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Socket layer can 
send data to NIC 
and NIC can send 
data to socket 
layer 
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702 



H/W handles the 
connection until it 
decides to transfer 
the connection 
back to S/W 
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Send indictator to 
S/W indicating that 

the H/W wants to 

transfer the 
connection to S/W 
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S/W TCP layer retrieves the 
hardware connection state and any 
unsent data associated with the 
connection from the H/W 
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S/WTCP layer 
handles the 
connection 
normally 
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(Connection "N 
suitable for ) 
offloading to H/W? J 



802 \f 



When connection is 
established, 
S/W determines whether 

the capabilities of the 
TOE NIC card enable the 
TOE NIC card to handle 
the connection 
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Processing at 
803 \T blocks 602-606 



At block 608 of FIG. 6, 
determine size of file 
to write; If size < 
MIN_TRANSFER, 
not suitable for 
offloading 



When offloading to 
H/W is 
appropriate, 
offload when TCP send 
window is open 
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TOE driver 
triggers transfer of 
the connection 
from H/W back to S/W 
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TOE NIC driver keeps copy 
of state information for 
the connection 



^1002 



TOE NIC driver provides the 
state information to the 
TOE capable NIC 



c 



I 



vT 1 



Inbound 
data 



X 



J y 1006 



(Outbound "\ 
data J 

JL ' 



TOE capable NIC 
receives packet from 
network 



Socket layer provides packet 
to TOE NIC driver 



J_ 



1008 



TOE capable NIC 
performs TCP 
processing and passes 
packet to TOE NIC 
driver 



TOE NIC driver stores 
copy of the packet 

1 



TOE NIC driver provides the 
packet to TOE capable NIC 
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TOE NIC driver 
confirms that it 
received packet from 
TOE capable NIC 



TOE capable NIC transmits 
the packet to client 
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TOE capable NIC 
sends ACK 



TOE NIC receives 
ACK from client 
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TOE capable NIC 
informs the 
1024 \f| TOE NIC driver 

that it received the ACK 



TOE capable 
NIC driver 
discards copy 
of the packet 
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